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BACKGROUND OF THE INVENTION 

This invention relates generally to control devices, and more particularly to force 
feedback control devices. 

20 Control devices can be used for a variety of different control tasks. A user can 

conveniently select or operate different functions and features of a device using the 
control device. In some cases, the control device allows a user to operate or interlace 
with a device remotely, without having to operate controls located on the housing of the 
device itself. For example, signals can be sent from the remote control device to the 

25 controlled apparatus. In addition, the control device preferably offers a more intuitive 
and easy-to-use way of interfacing with a device than using other inconvenient, bulky, or 
unintuitive controls. 

Control devices can be implemented in a variety of forms. In hand-held 
embodiments, it is desirable for control devices to be lightweight and convenient to hold, 
30 and to include controls that are straightforward to use, comfortable, and effective in 
controlling the features or operation of a device. Typical control devices of the prior art, 
however, may not include all these features. For example, a standard joystick device may 
not be very convenient for use in controlling functions since it either requires two hands 
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lo operated (one hand holding the device, the other hand operating the joystick), or it 
requires a table top or other surface on which to rest the joystick. Some attempts have 
been made to develop one-handed joysticks, but these devices often end up clumsy and 
ineffective. Similarly, gamepad controllers, commonly used to interface with video 
5 games provided by game consoles, require the use of two hands and are thus inconvenient 
in many applications. 

In embodiments where a device is not hand-held, there is still a need for a 
controller device having superior precision, ergonomics, and convenience. Furthermore, 
such a device that can readily include force feedback functionality is also desirable. 

10 
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SUMMARY OF THE INVENTION 

The present invention provides a control device that allows a user to interface 
with an apparatus in a convenient and effective manner. The control device can also be 
5 provided with force feedback for added functionality and efficiency. 

More particularly, a control device of the present invention includes a housing and 
a carrier coupled to the housing and operative to move with respect to the housing in a 
first rotary degree of freedom. A first sensor senses the movement of the earner and 
outputs a first control signal. A roller rotatably coupled to the carrier rotates with the 

10 carrier in the first degree of freedom and rotates independently of the carrier in a second 
rotary degree of freedom. A second sensor senses rotary motion of the roller and outputs 
a second control signal. Preferably, an arm member is coupled between the carrier and 
the housing, where the am member pivots about an axis and where the first sensor senses 
rotation of the arm member. The roller rotates about an axis that is parallel to a plane of 

15 rotation of the arm member. The arm member can be positioned in the housing, where 
the housing includes an aperture through which the carrier and roller are accessible to a 
user of the control device. Preferably, a third sensor is also included to detect when the 
carrier has been pushed in a direction substantially orthogonal to a plane of rotation of the 
arm member. 

20 In another embodiment, force feedback functionality is preferably included in the 

control device. For example, a first actuator is preferably coupled to the arm and outputs 
a force on the arm in its degree of freedom. A second actuator can be coupled to the 
roller to output a force to the roller in its rotary degree of freedom. The first and second 
actuators are controlled by first and second actuator signals. The control device 

25 interfaces with an apparatus; the apparatus, for example, can be a host computer that 
provides force feedback signals to the control device based at least in part on the first and 
second sensor signals received from the control device. For example, the host computer 
can display a graphical environment, such as graphical user interface or game 
environment, in which a user-controlled graphical object is displayed, such as a cursor, 

30 having a position determined by the first and second sensor signals. Other graphical 
objects may also be displayed. In one embodiment, the first and second force feedback 
signals are determined at least in part based on an interaction of the cursor with a 
displayed graphical object. 
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A number of alternate embodiments of the control device are also provided. A 
second roller can be coupled to the earner and rotate with respect to the carrier 
independently of the first roller. Another sensor is provided to sense rotary motion of the 
second roller. The second roller can be oriented in the same direction as the first roller, or 
5 can be oriented orthogonally or in other configurations. Furthermore, a belt can be 
coupled between the first and second rollers which is accessible to be contacted and 
moved by the user. A rotating member, such as a cylinder or sphere, can be coupled to 
the housing and extend from a bottom plate of the housing, such that the rotating member 
contacts a flat surface and rotates when the control device is moved over the flat surface. 
10 The carrier can alternatively be coupled to the housing by contact bearings which sit in 
tracks on the housing and allow the carrier to move along the tracks. 

The device and method of the present invention provide an interface to an 
apparatus that provides greater control functionality and convenience for the user. The 
arcuate or linearly moving carrier portion is easily moved by a user's thumb, providing 

15 horizontal control over a cursor or other input. The rotatable wheel provided in the 
carrier allows the same finger of the user to control vertical motion of a cursor or control 
a different function of an apparatus. However, since the wheel rotates in a single 
position, the length of the carrier arm need not be adjusted greatly for differently-sized 
hands. Force feedback may also be added to the control device to provide the user with 

20 greater control and to inform the user of options and selections through the sense of 
touch. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following specification of the invention and a 
study of the several figures of the drawing. 

25 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure la is a top plan view of one embodiment of a control device of the 
5 present invention; 

Figure lb is a top plan view of the control device of Fig. la also including 
actuators for force feedback; 

Figure 2 is a side elevational view of the control device of Fig. la; 

Figures 3a and 3b are top plan and side elevational views, respectively, of the 
10 control device of Fig. la being used by the thumb of a user; 

Figures 4a and 4b are top plan and side elevational views, respectively, of an 
alternate grip for the control device of Fig. la; 

Figure 5 is a partial top plan view of an alternate embodiment of the control 
device of the present invention including two aligned rollers; 

15 Figure 6 is a partial top plan view of an alternate embodiment of the control 

device of the present invention including two orthogonal rollers; 

Figure 7 is a partial top plan view of an alternate embodiment of the control 
device of the present invention including two orthogonal rollers having perpendicular 
axes of rotation; 

20 Figure 8 is a side elevational view of an alternate embodiment of the control 

device of the present invention including a belt routed around two rollers; 

Figure 9 is a side elevational view of an alternate embodiment of the control 
device of the present invention including a cylinder for frictionally engaging a flat 
surface; 

25 Figure 10 is a side elevational view of an alternate embodiment of the control 

device of the present invention including a sphere for frictionally engaging a flat 
surface; 

Figure 11 is a partial top plan view of an alternate embodiment of the control 
device of the present invention including a carrier coupled to tracks by bearings; 
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Figure 12 is a top plan view of an alternate embodiment of the control device 
of the present invention including a display; 

Figures 13a and 13b are top plan and side elevational views, respectively, of 
an alternate table-top embodiment of the control device of Fig. la; and 

Figure 14 is a block diagram of a control system for the control device of the 
present invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



10 



FIGURE la is a top plan view of a first embodiment 10 of an interface control 
device of the present invention. Control device 10 includes a housing 12 and a moveable 
arm assembly 14. The housing 12 is intended to allow easy hand-held use of the control 
device. Thus, housing 12 is approximately of a size that will fit snugly in a user's hand 
and allow the user's thumb to reach the controlled portion of the arm assembly 14, as 
described in greater detail below. The edges of housing 12 are preferably rounded to 
allow comfortable use by the user. In other embodiments, the housing 12 need not be 
hand-held but can be used on a grounded surface (see Figs. 13a and 13b) or can be part of 
a fixed panel, keyboard, computer or other device housing, or other apparatus. Housing 
12 includes a first end 16a and a second end 16b, where the second end 16b is held away 
from the user and toward an apparatus interfaced with the device 10, if appropriate. 
15 Housing 12 preferably has a bottom plate 18a and a top plate 18b, which are spaced apart 
by sidewalls (not shown) of the housing 12 to define a space between the plates 18a and 
18b. 

Arm assembly 14 is rotatably coupled to the housing 12 between the bottom plate 
18a and top plate 18b. Assembly 14 includes an arm member 20 and a cylindrical roller 

20 22. Arm member 20 is coupled to bottom plate 1 8a and/or top plate 1 8b at a first end and 
may pivot about an axis A. A carrier portion 24 is coupled to the arm member 20 and is 
exposed to the user through an opening 26 in the top plate 18b. The carrier portion can 
be made as part of the arm member 20 or as a separate piece coupled to the arm member. 
Carrier portion 24 preferably has an opening 28 in its center which holds cylindrical roller 

25 22. For example, the roller 22 can be coupled to the carrier portion 24 by an axle 30 
which allows the roller 22 to rotate about an axis B. 

The roller 22 is preferably cylindrical and may include textures or other surface 
features to assist the user in creating frictional contact with the user's finger to turn the 
roller. For example, bumps, ridges, or other surface features can be provided, and/or a 
30 frictional material such as rubber can be included on the surface of the roller. In other 
embodiments, rollers of other cross-sectional shapes can be used, such as octagonal, 
hexagonal, etc. 
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A first sensor 32 is coupled to the ami member 20 near axis A to measure the 
rotation of the arm assembly about axis A. The sensor 32 can be a digital optical 
encoder, analog potentiometer, magnetic sensor, optical sensor (e.g. photodiode or 
photoresistor), or other type of sensor than can detect rotary motion of the arm member 
20 relative to the housing 12. The first sensor 32 outputs a first raw sensor signal 
indicative of the motion of the arm member, and can be a relative sensor or an absolute 
sensor. For example, if a relative sensor is used, the first sensor 32 can output a signal 
indicating the amount of rotation since the last detected position. 

In one alternate embodiment, an optical sensor can be used as first sensor 32 
and/or second sensor 34. In one type of optical encoder, optical fibers are used to 
conduct received light pulses to a set of photodetectors. Movement of a member over a 
striped pattern thus generates electrical motion signals. The moving elements of device 
10 may be coupled to a pattern member such as a code wheel or linear element, where 
optical fibers are used for remote motion sensing. Optical fibers are well suited to the 
device 10 due to the flexibility of the fibers, allowing the fibers to be routed from a 
moving optical pickup point (in the swinging arm) to a fixed photodetector location, such 
as on a circuit board mounted to the housing 12 of the device 10. In such an 
embodiment, mechanically-driven sensors would not be required. Alternatively, optical 
channels molded in and integral with a support structure can be used with an optical 
encoder instead of optical fibers. Such optical channel encoders are described in greater 
detail in application serial no. 60/067,381, incorporated herein by reference. 

A second sensor 34 is coupled to the axis 30 of the roller 22 to detect rotation of 
the cylindrical roller 22 about axis B. Sensor 34 can be grounded to the carrier portion 24 
to as to measure rotation of the roller 22 with respect to the carrier portion. Similar to the 
first sensor 32, the second sensor 34 outputs a second raw sensor signal indicative of the 
rotation of the roller 22. The sensor 34 can be a digital sensor or analog sensor, and can 
be relative sensor or absolute sensor, similar to the first sensor 34. 

Two axes of motion are preferably integrated in the control device 10. As shown 
in the top plan view of FIGURE lb, the arm assembly 14 can be moved by the user to 
provide input signals to the apparatus with which the user is interfacing. The user can 
contact the carrier portion 24 or the roller 22 with a finger and move the assembly left or 
right about the axis A using finger pressure. The carrier portion thus moves in a linear 
arcuate path. For example, in Fig. lb, the user has moved the assembly 14 in a direction 
from left to right, as indicated by arrow 36. Preferably, stops are provided at both ends of 
the opening 26 to limit the motion of the arm assembly 14. In alternate embodiments, the 
opening 26 can be made linear, and the motion of the carrier portion 24 and roller 22 can 
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be linear motion from one end to the other of the opening 26. In such an embodiment, 
roller bearings, sliding bearings, or other mechanisms can be used; for example, Fig. 1 1 
shows an embodiment in which such movement can be provided. 

The length of the arm member 20 can be varied in different embodiments to 
accommodate differently-sized fingers or hands; in some embodiments, an adjustable arm 
member 20 can be provided that allows a user to adjust arm length (a larger opening 26 
can be used to accommodate different arm member lengths). However, it should be noted 
that the roller 22 does not change its position along the arm member 20 to provide an 
adjustable input signal. Thus, a single, convenient arm length for member 20 can be 
provided that allows the user's thumb to reach the roller for most hand sizes. The motion 
of the carrier in left and right directions can also typically be accommodated by most 
hand sizes. 

In one preferred embodiment, this motion of arrow 36 controls the motion of a 
user-controlled graphical object, such as a cursor displayed on a display screen, in a 
horizontal linear degree of freedom, i.e. along an X-axis. Although the movement of arm 
assembly 14 is rotational about axis A, the arm member 20 is sufficiently long to allow 
the user to perceive the motion of the assembly to be almost linear, thus allowing easy 
mapping of the assembly motion to linear horizontal cursor motion. The motion of the 
assembly 14 is preferably mapped to cursor position according to a position control 
mapping, so that the position of the assembly 14 in its degree of freedom directly 
corresponds to a position of the cursor in the displayed degree of freedom. Thus, motion 
of the cursor to the left would stop at the left edge of the screen precisely when the 
assembly 14 reached a left limit to its degree of freedom, and a similar relationship is 
provided at the right edge of the screen and the right limit to the assembly 14. 
Alternatively, a rate control mapping can be provided between assembly 14 and the 
controlled graphical object. The rate control mapping is best provided when force 
feedback is implemented, as described below. 

In one preferred embodiment, the control of a graphical object such as a cursor by 
the control device 10 is provided in a graphical user interface (GUI) displayed by a host 
computer. The GUI includes several different objects, such as icons, pull down menus 
and menu items, windows, scroll bars, graphical buttons, sliders, links (in a web page) 
etc. The cursor can be controlled to manipulate and/or select these various graphical 
objects with the control device 10 of the present invention. In other embodiments, the 
motion of assembly 14 as shown by arrow 36 can control other motions of a cursor or 
other controlled graphical object, such as rotation or turning of a simulated vehicle 
controlled by the user. In yet other embodiments, this motion can control other functions 
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or motions, such as the changing of a volume for a stereo, the rotation of an apparatus set 
on a grounded pedestal, or the velocity of a controlled vehicle. A variety of electronic or 
computer apparatuses can be controlled by the device 10. For example, the controlled 
apparatus can be a home appliance such as a television set, a microwave oven or other 
5 kitchen appliances, a washer or dryer, an audio home stereo component or system, a 
home computer, a set top box or web browser appliance for a television, a video game 
console, a home automation system (to control such devices as lights, garage doors, 
locks, appliances, etc.), a telephone, photocopier, model vehicle, toy, a video or film 
editing or playback system, etc. Device 10 can be physically coupled to the apparatus, or 
10 the panel 12 can be physically remote from the device 10 and communicate with the 
device using signals transferred through wires, cables, wireless transmitter/receiver, etc. 

In one embodiment, force feedback is provided in the degree of freedom of 
assembly 14 using actuators. For example, an actuator 38 can be grounded to the housing 
12 and can output forces on the arm member 20 in the rotary degree of freedom about 

15 axis A. Actuator 38 can be an active actuator that outputs forces in the degree of freedom 
and can move the assembly 14 if conditions allow; active actuators include a DC motor, 
voice coil actuator, moving magnet actuator, hydraulic or pneumatic actuator, torquer, 
etc. Alternatively, actuator 38 can be a passive actuator that does not output active forces 
in the degree of freedom but provides resistance to motion when so controlled, such as 

20 magnetic particle brakes, hydraulic or pneumatic passive brakes, friction members, 
friction drive, electromagnetic coil wound about an ferrous core, etc. 

The use of force feedback in the degree of freedom of the arm assembly 14 can 
provide a variety of functions and greater ease of use for the user. For example, jolt 
forces or bumps can be output on the arm assembly 14 when the controlled cursor moves 

25 over a particular object, such as an icon or window border. Or, attractive forces can assist 
the user in moving the cursor onto a target such as an icon, menu item, or link in a web 
page, and resist motion away from the target once the cursor has moved onto the target. 
Other forces include detents, spring forces, repulsive forces, textures, damping forces, 
vibrations or other periodic forces, or obstruction forces. Such functionality is described 

30 in greater detail in co-pending patent application serial no. 08/571,606, incorporated 
herein by reference. Furthermore, a rate control mapping between the assembly 14 and a 
controlled object or function can be provided, where the amount of movement away from 
an origin position indicates a magnitude of input. For example, the origin position of the 
assembly 14 can be designated to be at the center of the degree of freedom of the arm 

35 assembly 14. A spring force is output that resists motion of the arm assembly away from 
the origin position, where the greater the deviation from the origin, the greater the 
resistive force that biases the assembly back to the origin. The amount of deviation from 
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the origin is directly to proportional to a magnitude of input. Thus, if the user is 
controlling the velocity of a cursor, the greater the assembly 14 is moved from the origin, 
the faster the cursor will move. The direction of the assembly from the origin controls 
the direction of the object or function. Functions such as motion, volume, velocity, or 
5 any parameter that can be changed can be controlled according to a rate control mapping. 
Furthermore, a rate control mapping and a position control mapping can both be used, as 
desired by the user and/or as selected by a host computer or other apparatus. Such dual 
functionality is described in greater detail in Patent 5,825,308, incorporated herein by 
reference. 

10 Motion of the cylindrical roller 22 about axis B, as shown by arrow 40, preferably 

provides a separate sensor signal and thus controls a separate function or motion of the 
controlled apparatus or object. The user preferably contacts the roller with a finger, such 
as the thumb, and rolls the roller in the desired direction. While resting on the roller 22, 
the user's finger can also contact the surface of the carrier portion 24, as well as the top 

15 edge 25 of the housing 12. This creates a frictional coupling between the finger and these 
three surfaces, which increases control stability. The roller 22 can be provided with a 
stop so that it rotates for a certain range, and then can no longer be rotated in that 
direction. Alternatively, the roller 22 can be provided with no stops so as to allow the 
roller to rotate freely in either direction with no limits. 

20 The roller 22 can control a variety of functions or motion. For example, in one 

preferred embodiment, the rotation of roller 22 controls the position of a displayed 
graphical object, such as a cursor, in a vertical linear degree of freedom, i.e. along a Y- 
axis. In a position control mapping, the position of the roller 22 in its degree of freedom 
is directly correlated to a position of the cursor in the vertically displayed degree of 

25 freedom. Such an embodiment can include one or more stops for roller 22 so that when 
the roller reaches a limit, the cursor has correspondingly reached the top or bottom edge 
of the screen. A rate control mapping can also be provided, which is more suitable for 
the force feedback embodiment as described below. Alternatively, the motion of roller 
22 can control other motions of a cursor or other controlled graphical object, such as 

30 rotation or turning of a simulated vehicle controlled by the user. In yet other 
embodiments, the roller motion can control other functions or motions, such as the 
changing of volume for a stereo, the rotation of an apparatus set on a grounded pedestal, 
or the velocity of a controlled vehicle. 

In one embodiment, force feedback is provided in the degree of freedom of roller 
35 22 using an actuator 42. For example, actuator 42 can be grounded to the carrier portion 
24, coupled to the axle 30 of the roller 22 by a belt or other transmission, and output 
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forces on the roller 22 in the rotary degree of freedom about axis B. Actuator 42 can be 
an active actuator that outputs forces in the degree of freedom, or a passive actuator that 
provides resistance to motion, as described above. 

The force feedback on roller 22 can be used in similar ways as the forces applied 
5 to arm assembly 14, described above. For example, detents, jolts, spring forces, attractive 
or repulsive forces, textures, damping forces, vibrations or other periodic forces, or 
obstruction forces can be output on the roller. Furthermore, a rate control mapping is 
preferably implemented using spring forces as described above with reference to the arm 
assembly 14. For example, the roller 22 has a designated origin position, and a deviation 

10 of the roller from the origin, in opposition to the spring forces, causes a function or 
motion to be controlled based on the amount of deviation from the origin. Furthermore, 
other force sensations that can be output on roller 22 include forces that simulate ends of 
travel for the roller or inform the user that the end of travel has been reached. For 
example, as the user rotates the knob in one direction, the end of the adjusted value range 

15 is reached. If there is no hard stop on the roller at this position, the actuator can be 
controlled to output an obstruction force to prevent or hinder the user from rotating the 
roller further in that direction. Alternatively, a jolt force can be output that is stronger in 
magnitude than normal detents, which informs the user that the end of the adjusted range 
has been reached. Other force sensations that can be applied to a rotatable knob-like 

20 control, such as a roller 22, are described in co-pending patent application serial no, 

09/ , by Levin et al, filed 10/26/98, entitled, "Control Knob with Multiple 

Degrees of Freedom and Force Feedback", assigned to the same assignee as the present 
invention, and which is incorporated herein by reference. 

The actuators 38 and 42 are preferably controlled with driver signals from a 
25 microprocessor or other controller. A suitable control architecture is shown with respect 
to Fig, 14, below. 

In some embodiments of the control device 10, the arm assembly 14 can be 
sensitive to inertial forces, which could cause undesired movement of the arm assembly 
in particular environments, such as in a moving vehicle. The sensitivity to inertia can be 

30 reduced or eliminated by coupling a counterweight to the arm assembly. For example, a 
pair of spur gears can be used, where one gear is coupled to the arm assembly, and the 
other gear is interlocked with the first gear and is coupled to a different arm member 
having a counterweight attached to its end. Both the arm assembly and the counterweight 
arm can be of approximately equal weight. The counterweight arm can be positioned 

35 underneath the arm assembly and can pivot in a plane substantially parallel to the plane of 
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rotation of arm assembly 14. The counterweight moves in an opposite direction to the 
arm assembly, thereby cancelling inertial movement of the arm assembly. 

FIGURE 2 is a side elevational view of the control device 10 shown in Fig. la. 
As shown, the arm assembly 14 preferably rotates a small distance above the bottom 
5 plate. A pressure switch 44 is provided under the earner portion 24 of the arm assembly 
14. When the user exerts downward finger pressure on the carrier portion 24 or the roller 
22, the carrier portion 24 flexes down to engage and change the state of the switch. 

Preferably, the engagement of the switch 44 is the equivalent of a " mouse click" 
in a standard mouse input device, or a trigger press in a gaming controller. Thus, when 

10 the user controls a cursor to acquire a target such as a graphical icon, the user can then 
push on the roller 22 or carrier portion 24 to engage switch 44 and select the icon or 
execute a program associated with the icon. Furthermore, the roller 22 can be moved 
while the carrier portion 24 is held in an engaged position with switch 44 to allow 
"dragging" of graphical objects such as windows and icons within the GUI. Switch 44 

15 can be implemented as other types of switches in other embodiments, for example an 
optical switch (for example, as described in co-pending application 60/067,381), 
magnetic switch, or other type of switch. 

FIGURES 3a and 3b are top plan and side elevational views, respectively, of a 
user operating the control device 10 with a finger. The user preferably uses a thumb to 

20 rotate the cylinder 22 and move the arm assembly left and right to control the X- and Y- 
motion of a controlled graphical object, or adjust the values for other functions or 
movement. The fingers of the user are preferably wrapped around the side and end at the 
bottom surface of the device 10 to hold the device cradled in the hand. In alternate 
embodiments, the user can use the control device with two hands, where one hand moves 

25 the roller/arm and the other hand manipulates other controls on the device, e.g. buttons, 
switches, etc. provided on other areas of the housing 12. In yet other embodiments, a two 
handed control device 10 can be provided, where the user grasps an extension to the 
housing past the roller with one hand and manipulates the roller motion with the other 
hand. 

30 Using the thumb to control positioning functions contributes to superior 

ergonomics in the control device 10 of the present invention. When a user traces his or 
her thumb across the tips of the other fingers, every joint in his or her hand moves in 
concert to facilitate the thumb's motion. The opposed position of a thumb relative to the 
other fingers is utilized by the control device 10 to achieve a comfortable and natural 

35 interface. Other advantages of a thumb control and a hand-held control device 10 are 
described in Patent No. 5,666,138, assigned to assignee of the present application, and 
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incorporated herein by reference. Other features in that patent can be applied to the 
present invention as well. In addition, a cylindrical control having linear motion is 
described in Patent Nos. 4,712,101; 4,724,715; 4,823,634; and 5,235,868, which are 
incorporated herein by reference. 

5 FIGURES 4a and 4b are top plan and side elevational views, respectively, of an 

alternate embodiment 10* of the control device 10, in which a molded hand grip is 
provided for the device. An arm assembly 14 and roller 22 are provided, which function 
similarly to the same components in the control device 10. The device includes a housing 
50 and a grip 52. In some embodiments, the housing 50 can be moved relative to the grip 

10 about axis A to allow the player to adjust the relative positions of the grip and housing to 
a more convenient position to operate the device 10'. The grip preferably includes 
moldings 54 which are shaped to fit the user's fingers and provide a comfortable grip of 
the device. Furthermore, the underside of grip 52 can also include a button 56 which is 
conveniently accessible to the user's fingers. In some embodiments, this button 56 can 

15 be provided in addition to the switch 44 to provide additional input. 

FIGURE 5 is a top plan view of an alternate embodiment 60 of the control device 
10, in which two rollers 62 and 64 are provided on the carrier portion 24 of the arm 
assembly 14, Each roller 62 and 64 is independently rotatable from the other roller and 
preferably provides a separate input signal to a computer or other apparatus. Thus, each 

20 roller preferably is coupled to a dedicated sensor (not shown). In the embodiment shown, 
roller 62 is rotatable about axis D, and roller 64 is rotatable about axis E (axes D and E 
may be coincident in some embodiments). The control device thus provides three 
separate sensor signals: one from each of the rollers 62 and 64, and a third from the left- 
right motion of arm assembly 14. The cylinders 62 and 64 can be positioned in separate 

25 apertures in the carrier portion 24, as shown, or may be positioned on the same axle 
directly side-by-side or separated by a ridge or groove. 

One example of a control setup for the control device 60 allows one roller to 
control X-axis movement of a graphical object, the left-right motion of the arm assembly 
to control Y-axis movement, and the other roller to control Z-axis movement, thus 

30 allowing three dimensional manipulation of objects or adjustment of values. In an 
alternate embodiment, the second roller 62 or 64 can be placed so that its axis of rotation 
is parallel to the axis of rotation of the other roller, e.g. one roller behind the other roller. 
Also, the second roller can be placed in other areas of arm 20, such as near the axis of 
rotation A so that the second roller still rotates with the arm; or on the housing near the 

35 axis A so that the second roller does not rotate with the arm. 
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FIGURE 6 is a top plan view of an alternate embodiment 70 of the control device 
10, in which two rollers are provided on the carrier portion 24 at different orientations. A 
first roller 72 is positioned to rotate about axis F, which is positioned approximately 
parallel to a tangential orientation to the rotation of the arm assembly about axis A. A 

5 second roller 74 is positioned to rotate about axis G, which is positioned approximately 
radially to the rotation of the arm assembly about axis A and approximately orthogonally 
to the orientation of axis F. Similar to the embodiment of Fig. 5, each roller 72 and 74 is 
preferably provided with its own sensor (not shown) so that independent input signals 
may be provided based on rotation of each roller. In one embodiment, the roller 72 can 

10 provide an input signal to control an object or function similar to the roller 22, while the 
roller 74 can provide an additional control feature for another function or value, such as 
movement in a third degree of freedom or axis. Alternatively, roller 74 might control 
coarse X-axis motion of the controlled object, where arm assembly motion provides fine 
X-axis control (or the roller 74 can control fine motion while the ami assembly controls 

15 coarse motion). This can allow x-axis control of a graphical object past the physical 
limits to motion of the arm assembly 14. 

FIGURE 7 is a top plan view of an alternate embodiment 80 of the control device 
1 0, in which a first roller 82 is provided in the carrier portion 24 as described above, and 
where the carrier portion 24 also includes a wheel 84. Roller 82 rotates about axis H, 

20 while wheel 84 rotates about axis I that is positioned approximately perpendicular to the 
plane of rotation of arm assembly 14 about axis A. Roller 82 and wheel 84 preferably 
provide independent input signals to a controlled apparatus, and thus are each detected by 
an individual sensor (not shown). As described with reference to Fig. 6, the roller 82 can 
provide the control functionality of roller 22 as described with reference to Fig. 1, and the 

25 wheel 84 can provide additional control functionality, such as coarse or fine control of X- 
axis movement or other movement, control of movement in a third degree of freedom, 
adjustment of a different value, etc. Wheel 84 is preferably a cylinder that provides a 
sufficient height to allow the user to comfortably engage the circumferential surface of 
the wheel. The user preferably engages wheel 84 on either side with a thumb, depending 

30 on which of the user's hands operates the control device 80. 

FIGURE 8 is a side elevational view of another embodiment 90 of the control 
device 10. In this embodiment, the roller 22 has been replaced with a belt assembly 92. 
Assembly 92 can be positioned in ami 20 or in carrier portion 24. A belt 94 is wrapped 
around two rollers 96 and 98 so that the user may cause the belt to travel around the 
35 rollers by engaging the belt with a finger and moving the belt toward the back or front of 
the device 10. The rollers 96 and 98 can be coupled to the ami member 20 by axles, 
similarly to roller 22. The belt 94 may be made of a frictional, stretching material such as 
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rubber or the like, and can alternatively be provided with teeth that engage teeth in roller 
96 and/or roller 98. Only one sensor need be provided to detect the motion of either 
roller 96 or roller 98. The sensor can be coupled to the rotating shaft of one of the rollers 
to detect its rotation. Alternatively, an optical sensor can be positioned to detect the 
5 passage of stripes or other marks that are printed on the belt, and thus measure the 
distance that the belt is moved. In some embodiments, an actuator can be coupled to 
either one of the rollers 96 or 98 to provide forces in the degree of freedom of movement 
of the belt. The movement of the belt 94 can be used to control, for example, the Y-axis 
motion of a controlled graphical object, or other motion or value. Furthermore, 
10 additional rollers can be included in arm assembly 14 in addition to the belt assembly 92, 
as shown in the embodiments of Figs. 5-7. 

FIGURE 9 is a side elevational view of an alternate embodiment 100 of control 
device 10 in which the device 100 may be moved similarly to a mouse to provide 
additional input signals to a computer system or other apparatus. A cylindrical rotatable 

15 wheel 102 is preferably provided near the front of the device 100 and extends out of the 
bottom panel 18a so that it may contact a surface 104. The wheel 102 preferably rotates 
about an axis C when the control device 100 is pushed across surface 104 by a user. A 
sensor (not shown) is preferably used to detect the motion of wheel 102, similar to the 
sensor 34 used with roller 22. Thus, the user may provide a third input signal to a 

20 computer or other apparatus by moving the device 100 in a desired direction. This 
motion is isolated from the other inputs based on roller 22 and arm assembly 14 motion, 
since the wheel 102 is moved by movement of the arm and hand of the user, not the 
finger resting on the carrier portion 24 or roller 22. 

The wheel 102 can facilitate forward and backward motion of the control device 
25 100 while restricting left and right motion. The input from the wheel 102 can be used to 
control a third axis of movement for a controlled graphical object or entity, or can control 
some other value, such as velocity, volume, etc. Furthermore, the wheel 102 can be 
provided with an actuator in an alternate embodiment to provide force feedback in the 
degree of freedom of motion of the control device 100. In an alternate mouse 
30 embodiment, the left and right motion of the ami assembly 14 can be used to move a 
cursor along the horizontal axis, while the forward and back motion of the device 10 
(detected by wheel 102) can be used to move the cursor along the vertical axis. This 
embodiment can be useful where there is not enough space to move the entire device to 
the left and right. The roller 22 in such an embodiment can be used for z-movement of 
35 the cursor or for a function not related to movement of the cursor. 
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In addition, the control device 100 can be provided with additional buttons, for 
example, on the top piate 18b to allow additional input signals. Switch 44 can be 
actuated similarly to the embodiment shown in Fig. 2, or alternatively, switch 44 can be 
provided as a button or switch on the bottom surface of bottom plate 18a so that a 
5 "mouse click" can be actuated by pressing downward on a switch on the rear of the 
control device, where the fingertips of the user are located. In other embodiments, wheel 
102 can be oriented in an orthogonal direction to the direction shown in Fig. 9, so that the 
sensor for wheel 102 reads motion of the device 100 in a left-right degree of freedom. Jn 
yet other embodiments, the wheel 102 can be replaced by a ball or other spherical object; 
10 this allows two additional signals to be output by the control device. The control device 
could thus be moved in two planar dimensions similar to a mouse, and control movement 
or values in a similar fashion. This is shown in Fig. 10, below. 

FIGURE 10 is a top plan view of a different embodiment 110 of control device 10 
in which a ball or sphere 1 12 is included at the back portion of the control device 1 10 to 

15 provide mouse-like functionality. Ball 112 can be held in place by multiple rollers, 
similar to standard mouse input devices, where two of the rollers are coupled to sensors to 
provide input signals for the horizontal movement and vertical movement, respectively, 
of the control device 1 10 on a surface. In a different embodiment, control device 1 1 0 can 
be provided with a wheel, similar to device 100, to input control signals for only one 

20 degree of freedom of movement (forward-back motion or left-right motion). 

FIGURE 11 is a top plan view of a different embodiment 120 of the control 
device 10 of the present invention, in which ball bearings are provided to allow the carrier 
portion 24 to move left and right in the opening 26 of the housing 12. Housing 12 
preferably includes tracks 122 in the edges of opening 26, in which are seated ball 

25 bearings 124 which are rotatably coupled to the carrier portion 24. The ball bearings roll 
within the tracks as the carrier portion 24 is moved left or right within the opening 26, 
such that minimal friction is provided and smooth movement obtained. Thus, in such an 
embodiment, the arm member 20 is not required to permit movement of the carrier 
portion 24. In other embodiments, sliding bearing surfaces can be used; however, such 

30 bearings tend to introduce greater friction in the movement of the portion 24. The 
opening 26 and tracks 22 may be curved as shown in Fig. 11, or alternatively may be 
straight. A roller 22 or any other combination of rollers or wheels as described herein can 
be provided in the carrier portion 24. 

FIGURE J 2 is a top plan view of a different embodiment 130 of the control 
35 device of the present invention, in which a local display screen 132 is coupled to the 
housing of the control device. Screen 132 can display information either stored in 
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memory local to the control device 10, or information received from an apparatus 
interfaced with the control device 130, such as a host computer or other device. For 
example, graphical and textual information can be displayed to assist the user in 
determining functions of the control device as related to the current program running on 
5 the host computer. In one example, as the user controls a displayed cursor over menu 
selections, information related to the menu selections from the host computer is displayed 
on the local display 132. In other embodiments, a larger display screen can be included 
to provide a self-contained, portable computer or game device, having graphical and 
textual images displayed thereon. The display screen 132 can be any of a variety of types 
10 of display devices, including LCD display, LED display, plasma display, etc. In some 
embodiments, display 132 can include a touch-sensitive surface to allow a user to touch 
displayed images directly on the display to select those images and an associated setting 
or function. 

FIGURES 13a and 13b are top plan and side elevational views, respectively, of an 

15 alternate embodiment 150 of a control device of the present invention. Control device 
150 includes a base 152 and an aim assembly 154. Base 152 rests on a stable surface 
such as a tabletop. The arm assembly 154 can rotate with respect to the base 152 about 
an axis J. Preferably, stops 156 are included to limit the rotation of the arm assembly to 
left and right positions. The arm assembly 154 includes a roller 158 which can be rotated 

20 about an axis K and provide an input signal as described in the embodiments above. 
Additional rollers can also be included that can provide additional input signals. 
Furthermore, the arm assembly 154 can also include a fine adjustment wheel 160. This 
wheel can be similar to the wheel 84 described above with respect to Fig. 7. 
Alternatively, wheel 160 can physically rotate the arm assembly 154 about axis J when 

25 the wheel is rotated. This can be accomplished, for example, by providing a rotatable 
contact member 162 that contacts a surface of the base 152 and rotates when the arm 
assembly 154 is rotated. Contact member 162 can be connected to wheel 160 so that 
when the wheel 160 is rotated, the contact member also rotates against the base 152 and 
forces the arm assembly to move. Buttons 164 can be included to provide additional 

30 input signals when pressed by a user. 

When the device 150 is used by the user, the user preferably places his or her hand 
so that the index and middle fingers are positioned on the arm assembly and the palm of 
the hand is near the axis J. The index and middle fingers are preferably touching both the 
roller 158 and the base surface 166 to provide stability. The wheel 160 and the buttons 
35 164 on the left side can be manipulated by the user's thumb (assuming the right hand is 
being used), while the buttons on the right can be manipulated by the user's ring and 
pinky fingers. 
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FIGURE 14 is a block diagram illustrating an electromechanical system 200 
suitable for user with the control device of the present invention. A force feedback 
system including many of the below components is described in detail in co-pending 
patent application serial no. 09/049,155, filed 3/26/98, and Patent number 5,734,373, 
5 which are both assigned to the assignee of the present invention and incorporated by 
reference herein in their entirety. 

In one embodiment, device 10 includes an electronic portion having a local 
microprocessor 202, local clock 204, local memory 206, sensor interface 208, and 
actuator interface 210. 

10 Local microprocessor 202 is considered "local" to device 10, where "local" 

herein refers to processor 202 being a separate microprocessor from any other 
microprocessors, such as in a controlling host computer or other apparatus 218, and refers 
to processor 202 beipg dedicated to force feedback and/or sensor I/O for the device 10. 
In force feedback embodiments, the microprocessor 202 reads sensor signals and can 

15 calculate appropriate forces from those sensor signals, time signals, and force processes 
selected in accordance with a host command, and output appropriate control signals to the 
actuator. Suitable microprocessors for use as local microprocessor 202 include the 
8X930AX by Intel, (he MC68HC711E9 by Motorola and the PIC16C74 by Microchip, 
for example. Microprocessor 202 can include one microprocessor chip, or multiple 

20 processors and/or co-processor chips, and can include digital signal processor (DSP) 
functionality. Also, "haptic accelerator" chips can be provided which are dedicated to 
calculating velocity, acceleration, and/or other force-related data. Alternatively, fixed 
digital logic and/or state machines can be used to provide similar functionality to 
microprocessor 202. 

25 A local clock 204 can be coupled to the microprocessor 202 to provide timing 

data, for example, to compute forces to be output by actuator 70. Local memory 206, 
such as RAM and/or ROM, is preferably coupled to microprocessor 202 in interface 
device 10 to store instructions for microprocessor 202, temporary data, and other data. 
Display 132 can be coupled to local microprocessor 202 in some embodiments. 

30 Alternatively, a different microprocessor or other controller can control output to the 
display 132. 

Sensor interface 208 may optionally be included in device 10 to convert sensor 
signals to signals that can be interpreted by the microprocessor 202. For example, sensor 
interface 208 can receive signals from a digital sensor such as an encoder and convert the 
35 signals into a digital binary number. An analog to digital converter (ADC) can also be 
used. Such circuits, or equivalent circuits, are well known to those skilled in the art. 
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Alternately, microprocessor 202 can perform these interface functions. Actuator interface 
210 can be optionally connected between the actuators 38 and 42 and microprocessor 202 
to convert signals from microprocessor 202 into signals appropriate to drive the actuators. 
Actuator interface 210 can include power amplifiers, switches, digital to analog 
5 controllers (DACs), and other components, as well known to those skilled in the art. 
Actuator interface 210 circuitry can also be provided within microprocessor 202 or in the 
actuators. 

A power supply 212 can be coupled to actuators 38 and 42 and/or actuator 
interface 210 to provide electrical power. In a different embodiment, power can be 
10 supplied to the actuators and any other components (as required) by an interface bus. 
Power can also be stored and regulated by device 10 and thus used when needed to drive 
the actuators. 

Sensors 32 and 34 sense the position, motion, and/or other characteristics of arm 
assembly 14 and roller 22 along one or more degrees of freedom and provide signals to 

15 microprocessor 202 including information representative of those characteristics. A 
single compound sensor can be used for multiple degrees of freedom. Examples of 
sensors suitable for sensors 32 and 34 include optical encoders, analog sensors such as 
potentiometers, Hall effect magnetic sensors, optical sensors such as a lateral effect photo 
diodes, tachometers, and accelerometers. Furthermore, both absolute and relative sensors 

20 may be used. 

In those embodiments including force feedback, actuators 38 and 42 are provided 
to transmits forces to arm assembly 14 and roller 22 in response to signals output by 
microprocessor 202 or other electronic logic or device, i.e., the actuators are 
"electronically-controlled." The actuators 38 and 42 produce electronically modulated 

25 forces which means that microprocessor 202 or other electronic device controls the 
application of the forces. In some embodiments, additional actuators can also be 
provided for other controls on device 10 (such as buttons, gamepad, etc.) or degrees of 
freedom of arm assembly 14. Actuators 38 and 42 can be active actuators, such as linear 
current control motors, stepper motors, pneumatic/hydraulic active actuators, a torquer 

30 (motor with limited angular range), voice coil actuators, etc.; or passive actuators, such as 
magnetic particle brakes, friction brakes, or pneumatic/hydraulic passive actuators, in 
some embodiments, sensor/actuator pair transducers can be used. 

In some embodiments, a drive transmission such as a capstan drive mechanism 
can be used lo provide mechanical advantage to the forces output by actuators 14 and/or 
35 22. Some examples of capstan drive mechanisms are described in patent no. 5,731,804, 
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incorporated herein by reference. Alternatively, a belt drive system, gear system, or other 
mechanical amplification/transmission system can be used. 

Oilier input devices 214 can be included in control device 10 and send input 
signals to microprocessor 202. Such input devices can include buttons provided on 
5 various locations of housing 12 and/or carrier portion 24, used to supplement the input 
from the arm assembly and roller 22. Also, dials, switches, voice recognition hardware 
(e.g. a microphone, with software implemented by microprocessor 202), or other input 
mechanisms can be used. Furthermore, a safety or "deadman" switch 216 can optionally 
be included in those implementations providing force feedback. The safety switch 
10 prevents forces from being output when the user is not contacting the roller 22 or earner 
portion 24, and to prevent these components from moving on their own when the user is 
not touching them. The safety switch can detect contact of a user's digit (finger, thumb, 
etc.) with the components using a sensor such as a capacitive sensor or resistive sensor, 
pressure sensor, optical sensor, etc, 

15 Controlled apparatus 218 is preferably included to communicate with local 

microprocessor 202 or other electronic components of control device 10. 
Microprocessors 202 and 218 are preferably coupled together by a bi-directional bus 220. 
Additional electronic components may also be included for communicating via standard 
protocols on bus 220. These components can be included in device 10 or another 

20 connected device. Bus 220 can be any of a variety of different communication busses. 
For example, a bi-directional serial or parallel bus, a wireless link, or a uni-directional 
bus can be provided. 

Controlled apparatus 218 can be any of a variety of devices, including a host 
computer, appliance, or other device as described with reference to Fig. la. 

25 Microprocessors 202 and apparatus 218 can exchange information as needed to facilitate 
control of various systems, output event notifications to the user, etc. For example, 
apparatus 218 can be a host computer including a microprocessor that commands the 
local microprocessor 202 to output force sensations by sending host commands to the 
local microprocessor. The host computer can be a personal computer, workstation, video 

30 game console, or other computing or display device, set top box, "network-computer", 
etc. Besides a microprocessor, the host computer preferably includes random access 
memory (RAM), read only memory (ROM), input/output (I/O) circuitry, and other 
components of computers well-known to those skilled in the art. The host computer can 
implement a host application program with which a user interacts using control device 10 

35 and/or other controls and peripherals. The host application program can be responsive to 
signals from control device 10 such as the motion of the arm or knob, or button presses. 
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In force feedback embodiments, the host application program can output force feedback 
commands to the local microprocessor 202, using, for example, a force feedback API of 
the host computer, such as I- Force from Immersion Corporation. In a host computer 
embodiment or other similar embodiment, microprocessor 202 can be provided with 
5 software instructions to wait for commands or requests from the host computer, 
parse/decode the command or request, and handle/control input and output signals 
according to the command or request. 

For example, in one force feedback embodiment, a host computer can provide 
low-level force commands over bus 220, which microprocessor 202 directly transmits to 

10 the actuators. In a different force feedback local control embodiment, the host computer 
provides high level supervisory commands to microprocessor 202 over bus 220, and 
microprocessor 202 decodes/parses the commands and manages low level force control 
loops to sensors and actuators in accordance with the high level commands and 
independently of the host computer. In the local control embodiment, the microprocessor 

15 202 can independently process sensor signals to determine appropriate output actuator 
signals by following the instructions of a "force process" that may be stored in local 
memory 206 and includes calculation instructions, formulas, force magnitudes (force 
profiles), and/or other data. The force process can command distinct force sensations, 
such as vibrations, textures, jolts, or even simulated interactions between displayed 

20 objects. Such operation of local microprocessor in force feedback applications is 
described in greater detail in Patent 5,734,373, previously incorporated herein by 
reference. 

In an alternate embodiment, no local microprocessor 202 is included in interface 
device 10, and a remote microprocessor in apparatus 218 controls and processes all 
25 signals to and from the components of interface device 10. Or, hardwired digital logic in 
device 10 can perform any input/output functions to the device 10. 

While this invention has been described in terms of several preferred 
embodiments, there are alterations, modifications, and permutations thereof which fall 
within the scope of this invention. It should also be noted that the embodiments 
30 described above can be combined in various ways in a particular implementation. 
Furthermore, certain terminology has been used for the purposes of descriptive clarity, 
and not to limit the present invention. It is therefore intended that the following 
appended claims include such alterations, modifications, and permutations as fall within 
the true spirit and scope of the present invention. 

35 What is claimed is: 
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